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ABSTRACT 

The questions of whether undergraduate students use 
different processes in evaluating thfeir own learning in a course, and 
whether such differences are related tc differences in personality 
development or cognitive development were studied. It was predicted 
that students possessing well developed abstract conceptual 
structures would show a more deliberate use cf the evaluation process 
and a greater degree of differentiation in. their self evaluation. 
Levels of conceptual development of undergraduates in a home 
economics education curriculum were Ineasured. Results of assessing 
stuients» self evaluation, correleited with scores cf conceptual 
level, indicated that most students' judgments were based on personal 
expressions of goodness or badness rather than on objective 
references. Little or no differentiation was observed in their 
judgments, nor were conditional judgments indicated, it was concluded 
that educators should examine not only the content of students' self 
evaluations, but also the "contexts" cf their judgments and the 
processes used, and that if students' evaluations are used as a basis 
for planning learning and instruction, .this nay undermine the 
intellectual aims of education. It was suggested that students' self 
evaluations may be used to aid them in developing higher cognitive 
and motivational orientations. (HH) 
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^E^Sfjt^iTi:np^ EDucariONAL ccmiERisr of the stut 

Differing poizzcs zrf ^.ev exLsx regarding^ the proper inte orstation and 
use of students' ^raiosciiaEs of ^tbeir own '^"^f^ij]-^ and perforfflwace in a 
course. Among soaae edeators, is common ^grsctlLce t:o acc at face 
value, students' sl^- -assefflment::^, ^:ad, to ^a^e?: t^lcei as the 1 is ^or action 
taken in instrucriio-^^^. liad prograaBBBiic X'i^5=— =^9 or even ^ ^ them as 
the "basis for cfa.emgj'^Tig' "jgnat aiuii how inuc>i "been le^arEEc In such 
i:2ltuation atter - parfi OTiiy tc^Tdie cont^mt of vi^M:: in .vrsocrted in 

^udents' self^ms9nmm»^sfrz^ and idie. ^ is no xncem ttor Tije prQ?cess students 
e iin assessii^^;^ ^ : ^ r inifrafis^ ani: --iaming a c^»:^ee. 
Bmcators vith ia -' 7:±Ltn.v£ devECTmentte-r^serspeccive : .-e ncs:^ so willing 
x.-e such indir'7 Jti^ ?ite interprsaration: - ofrstudeirts ' self-n«tf»essments as 
^ - WEES for actiom In education. "SBwr^int out that a prudent 

**e«iuation" is .a' "^i'/ifffee expiautiion hy the ^udent, but the bases or the 
c ntext in which "sa^r^ssion is utterai onsy differ from stsaiient to 
student. Very dif^feltoit kinds of processas (san he used hy the students in 
arriving at ev&Luaizaff aitatements. The prx^csss cax: he an emotioneil or 
capricioois one in wr±dt tuere axe not jg coi >uuL=> or reasons which serve as the 
basis of a Judgmental eaqpr^ession or it cac he deliberate and reflective 
process guide by reaaons or it can be aubj«esed to examination for their 
intellectual and mor«L*_ltgitlmacy (Bebell ^ Ig67 ; Wilhelms, 196? ). Therefore, 
interpretation of si iif fl ' self-assesflBboifcs mist go beyond examination of 
the obvious content ^aT ^glat is reported acff^xncludB determination of the 
context of ill iil ( iiii iil 1 imiii iiifj up the self^-aapessments. 
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Assnmit^ that all eiMomtasrs are caaae=3ffid, and iiave the social respon- 
sibility ti be concerned (f^ t;hEt acticas: -=aken in enaication as a result of 
stiident er^ -ation 5a Jiasttifiablfi, and (4)J i:hat evaination be a rational and 
deliberate ' nmcess , :±b sMueS reasonable te question^ whether interpreting 
or treatij*i|^all stuosntfi' self-assessment «iike is a sound practice for 
educators "Tto ±t£Ilov. Sin« eridcnce from previous ssaidies suggests that 
students use distiinctUj- difffereait modcE -of evalua±±orr ±n evaluating 
instructljw '€r±z:teattQm t 3farrr, 19T3; ^I&eientsfflum, 1975; iWrersciium, 1977) 
it seems reasmaijlfc 'Question iftether' stajdents reflectt thene variations 
in evaluating their cam Jeifiling and per j^ririiim ce in acOTrsrse. To put it mere 
specifically, ir: aeeME • aiotwiWLe to-ask -rticther all rvzaessxts are equally as- 
rational and deiiicnate iii evaluating thesr i^'wn perfoaa^ni^ and learning in 
a course. It seaaeF apjrropirijate f<^ eiucatojte -zo be irrs—ssted in determinr^s 
factors vhich can pi»^'11ct rten stwdents are capable of :»k±2ig rational and 
deliberate self -cnraxuations . 

!rhese concerns cacempliify a comrem far %hat is viasr to dc?" or 
practical knottiedge Trathesr Uhan vith " whfc^ is the case?' or -cseoretical 
knowledge (Habacimaa^ 19731). Since educaCiazr is a practical Celd, a concern 
for using theoretictal J^aowLn^gr guife ^iractice is approprdaefce in research^ 
Therefore, in this ssaS^ , thesafetdcal oiiestlons vere raised ±n order to gain 
practical knowledge. Tw thssownlcal caestions vere raised: (l) whether 
students' differ in the poroeems used in evaluating their ovn performance and 
learning in a cotirse asS [ZI' vhetoer sxich differences might be related to 
differences in students^ pcEssmaiLrby structure or level of cognitive 
development . 

iatiftUU-CAL FRAMEWORK 
A descriptive theory of rwalDBBtion, drawn from philosophic explication 
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of the concept in education (ScriTin, 1968) and in philosophy (Taylor, 1961.; 
Dewey^ 1966) vas developed in order to define the nature of the process of 
evaluation and to identify variations in the process. Two variations of 
concern in this study were: (a) the degree of deliherateness in self- 
appraisal and (h) the degree of differentiation in the jiadgments made. Degree 
of deliherateness in self-appraisal refers to the extent to which the value 
claims made are "based on objective grounds or references. Variation in 
degree of deliherateness in self-appraisal was described as ranging from mere 
JudgmentauL expression without criteria or evidence to a highly deliberate 
process in 'sriiich criteria are clearly identified and differentiated, relevant 
evidence cited, and the jMgment is drawn from these criteria and evidences 
cited. Degree of differentiation in the Judgments made refers to the extent 
to which the value Judgments are qualified and multidimensional Judgments. 
Variations in degree of differentiation in the Judgments made was described 
as ranging from Judgments which are polarized and absolute in nature, 
describing the goodness or badness of seme one global feature of the value 
object, to Judgments which are qualified, non- categorical and multidimensional 
in relating and comparing how the details and attributes of each aspect of 
the value object being Judged is considered good or bad according to 
different value perspectives. 

The paradigm used for relating students' personal characteristics to 
mode of self -evaluation was that proposed by the conceptual model of 
Lewln (1935) and Bmnswik (reported in Rappaport and Summers, 1973), which 
postulates hrnnan action to be a function of the psychological characteristics 
of the person interacting with qualities of the environment. 

More specifically, Brunswik's "lens" model which is concerned with a 
specific part of action, human Judgment, was used to specify a way of 
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vievlng students as evaluators. In the "lens" model, each pesrscm is TifW^d 
as an active agent approaching Jiadgment using his own lens, ^ich conss^sfe 
of the concepts, values, needs, att±±Tjies and beliefs of the pearson. 
person uses this isns to interpret s&a integrate the infonnatim evail^-ie 
in the environnient about the object tjo be Judged, im order to zmake a 
Judgment . Juagaentsmade depend on tte way a person^s lens allo57s that 
person to deal vith environmental cues (Pigure l). 



Object 




Cues 

= Environment Sp = Person *s 

System Cognitive Syst. 

Figure 1: Diagram of Brunswik's lens model showing the relationaliij 
ainong cognitive and environmental systems and the persoc^^ . 
Judgment. (Adapted from Rappaport and Summers, 1973). 

This view of human Judgment is related to a particular paradigm f . 
viewing human behavior first identified in psychology. Lewin rejectee t?" 
two models of huinan behavior used by psychologists and proposed that 
behavior is not dEteimined solely by stimuli in the environment or bj ir^'^ate 
qualities of the individual. He proposed, rather, that hunHn behaviczr " 
the result of an interaction between personal and environmemtal factors. 

Since this paradigm is a conceptual framework and not a predictive 
theory. Conceptual Systems Theory was used to formulate specific hypothesfli^. 
This theory la in the context of the model of Lewin and Brunswik and is 
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-mbstaasstiarely pB«^r!thceiof human actios on the haais or a person's Imown 
qnalisie^in iss^^^fccBS with the envlroiment ino?s^;^alities. (Harvey, 
:^a»rt lana^jashrocafir. 19^; Schroder, Driver and Streufert Z96T; anfi Hunt, 1971). 
Z:i canraptaal i^^gystezBS theory, the coniceptual sy sit an. nf a pers?on is considered 
"be furnztsaaaalZ^' ^^siafced to hov that jearson uses >t^- leis ixi perceiving 
rspoiaaS^^*^ -2c aawironment . Differences in inndea. of ac* ii^g (e.g., 
p^'T-ii^iviiK^ int?wpPT-ei23g or integrating ^niformation) hy fiiffer' nt: persons , in 
thfc same co^ crF:e fi^Mi«^.ion, are due to cifferences in ijcsq. mnceptual 
sys^wans. "La tb^ : aeary* the conceptual system is defined ^ -he self-system 
axsi La ussesd as ^: wfi^T" to viev each personals a total syst^ hsvin^ a basic or 
geiiLiLypic ^IgposdKisLai which can "be used in predicting, aining and giving 
c nr=rri steir?^ *so a -^jsscson's mode of acting. The conceptua^L system is made up 
of conc^^Jtual linkages or ties, called concepts, vhlrrh each person 
estOiKLisbe's with t^sae vorld. A person's concepts develop an organization or 
sttocture *s thesft croncepts change from concrete to abstract in nature and 

sii^'*:* aaad inrrelated to complex and integrated. ^The degree of ahstractness 
3anr aompl«ity of a^erson's conceptual system is assmed to he interrelated 
"^r fbe decree of complexity in that person's mode of fSCictioning. Conceptual 
j^ijalaaas -nheory defines and establishes developmental isrels of the conceptual 
■ ifl I'liui^ «ith each level being characterized by differetsc«s in a person's 
cqKi^iivg cuid motivational orientations. More specifical ly, this system 
Vfflrl^^in tiro cEimensions : (a) the complexity with whict information is 
cpgnisd^Bly prox^ssed and (b) the degree of interpersona2L mattirity. 

An^^is of conceptual systems theory and empirical "evidence from 
remarcrr concerned with the effects of a person's level xi^ cognitive and 
notlmtional development (or s elf --development } on that person's mode of 
act±zig suggested (a) that students vary in their level of conceptual 
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developmBnt (5ant, 1977? tod (Jb) that lercl rf conceptual dereJs^msnr. may 
affect stiitents' use of tS» evaluation prccess. (BerkowitZj ig^4..;aiite and 
Harvey, igfe>). This war''^^3o particularir Trtien Ca) the ohject ierng 
evaluated 1^-the self, ^MfesoL, I93U; Allpor. , 1955; Carr, 1965; and Loevinger, 
1966: (b) -URE process is^ aanplex one invdving xise of reasons ^mt reasoning, 
(Schroder -?rzal., 1967; mad Hint, 1971) (c) the situation involTres ^.sclosing 
infLLjiiiBttian about oneself -be Baother person (Halverson and Shore, -^969; 
Joute-' I9T1). Students' :3e«ls of conceptual development is fiiiiirtn.onally 
relsL2d ~ 0 (a) their abilitv to viev self objectively and (b) the intentions, 
piraproes activations and spsis of meanings students bring to and use in 
copsltiTc ' and interpersonal processes. When evaluation of one's own actions 
as a student is a rational ..d deliberate process, a student has the purpose 
or IfitentSmx of responding the basis of a value Judgment which concludes 
a^»3taac=ic process of ewiliation, rather than responding in any other way. 
Imsditian, a student iaLstitionally seeks out information which can be used 
tciznake an accurate, complete, and objective interpretation of the goodness 
of several aspects of his/her own learning and performance as a student, on 
the whole and in the long run, rather than stating here-and-now experiences 
or over-generalized interpretations of the goodness of his/her own learning 
and performance in a course. 

Persons at immature levels of conceptual development have little sense of 
self, do not differentiate between self and others, and have a very 
undifferentiated view of self. Their conceptual systems are made up of 
concrete and simple concepts and they have difficulty using these undifferen- 
tiated concepts in cognitive tasks. They do not seek out information but 
rather rely on the ideas and directives of authoritative others to guide their 
thinking and actions. Disclosing Information about themselves to others 
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causes anxiety and they draw* quick closure in suck^itaistions. On the other 
hand, persons at mature leTels of conceptual devel^oEBit have a Mghly 
differentiated viev of self and others. They have TnmmJ ated PAT^y 
differentiate and integrated internal standards they can use ±n directing 

their own thinking and acting. Yet, they are cpen. tr nev and conflicxxng 
ideas and tbey seek out infonaation from others heTcrre responding to a 
cognitive task. They can respond to cognitive taats and social situations 
in alternative vays. They are not threatened by isszjig to disclose infonaation 
about themselves to others. Therefore, in this stnidL-s it \ras hypothesized 
that a student's level of conceptual development affects that student's 
ability to respond conceptually, using the intenzaonal and ideational 
thinking required by the process of evaluation. It was predicted tiat in 
evaluation of self-perfoimance and self-learning in a course, those students 
having developed more abstract conceptual structures, as conrpared to those 
students at lover developmental levels: 

a. would show a more deliberate and complete use of the yx zess of 
evaluation and 

b. would in the Judgment made, show a greater degree of differentiation. 

DESIGN MP PROCEDURES USED US THE STODY 
Since the purpose of this study was to use students' basic mode of 
interacting with qualities of the environment to explain and predict 
particular students' action, in this case, mode of self-evaluating, a 
representative sample of students who were known to vary in level of 
conceptual development rather than a random sanrple was used in the study. 
In this study, the sample consisted of 68 students enrolled in the same 
undergraduate course in the home economics-education pre-service professional 
preparation curriculum at the University of Minnesota. Differences in level 
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of conceptaai^ awelopment were observed by structiiral analysis of students' 
responses tts TEwTTTF ' s {l9T^} paragraph cozspletlon test ad]ni.n2.stered to groups 
of students, "fflaafients' responses were assigned a score along the continuous 
conceptuaL level diniension. A high score on the dimension was assigned to 
paragraph icoaipLetions vhich showed consideration of two view points, co- 
ordination of differential responses, clear indication of self-delineation, 
and xise of internal standards. A low CL score was assigned to paragraph 
completioiBB which were undifferentiated and categorical responses , based on 
use of an overgeneralized or unqualified acceptance of a single rule and use 
of only esztsmal standards. 

Since the goal in observation was to gain knowledge of the process of 
evaluation used by students, they were provided with the unstructured task 
of generating their own schema for evaluating their accanrplishments in a 
course, rather than being given a structural instrument to use in evaluating 
their accomplishments as students. In the course in which the self- 
evaluations were collected, the instructor simply requested students to 
write an evaluation of their own learning and performance in the course. 

Variations in mode of self-evaluation were observed by conducting a 
structural analysis of subjects' self-evaluations using two interval 
sc€LLes developed by Brown (1976). A complete description of these scales 
as used in this study can be foruhd in the original and more extended 
writing related to this study (Wilsman, 1978). Students' self-evaluations 
were assigned a score along a continuous dimension. On the degree of 
deliberateness in self-appraisal, a high score was given to responses in 
which criteria for all Judgments were explicitly identified and differentiated, 
evidence was cited to support £lL1 Judgments, and Judgments were based on 
the criteria and evidences cited. Low scores were given to responses in which 
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no ejcpllcit criteria vere identified, no evidences were cited, and only a 
Judgmental expression was made. On the degree of differentiation in 
Judgment scale, a high score was given to self -evaluations which expressed 
consideration of two or more views with respect to aspects of accamplishments 
in the course and which gave the meaning of each view together with an 
explanation of how the different interpretations occurred. A low score 
was assigned to responses in which the Judgments made were polarized and 
alternative interpretations were not considered. 

Scores on the measure of conceptual level were correlated with scores on 
each of the scales to assess mode of self-evaluation hy means of the Pearson 
prodiict moment correlation. The .05 level of confidence was used to determine 
whether the correlation coefficient obtained in testing each statistical 
hypothesis had a probability other than zero. 

Results of the Study 
Two types of inferences were made when interpreting the results of the 
data analysis: (a) general-type propositions which were made when the 
statistical data and results were used within the inference model and 
(b) aggregate-type propositions which were made when the statistical data 
were used within the decision-theory model (Bakan, I967). This latter 
model seemed appropriate to use since the aims of the study were related to 
the acquisition of practical knowledge to be used in deciding the proper 
interpretation and use of students' self -evaluation by educators, rather 
than the creation of theoreticauL knowledge. 

Analysis of the distribution of students' scores according to the scales 
used to assess mode of self-evaluation indicated that students do vaiy in 
the modes or ways of making self-appraisals and that students' Judgments 
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about their ovn learning and performance in a coxarse do represent very different 
types of statements. More specifically, there was a moderate distribution 
of students' scores according to the scale used to assess the degree of 
deliberateness in self -appraisal. Less than half of the students made 
value Judgments iriiich were supported by objective references (i.e., criteria 
and evidences). In other words, most of the students in this study made 
Judgments vhich were little more than personal expressions of goodness 
(or badness), having only a personal reference, rather than value Judgments 
which were grounded in objective references of ejcperienced goodness. While 
some students did cite objective references to support their Judgments, no 
students mflde value Judgments supported by criteria which were clearly 
identified and differentiated so that the evidences cited could be interpreted 
in terms of the criteria specified. 

In regards to the distribution of students' scores according to the scale 
used to assess the degree of differentiation in Judgments made, the 
majority of students were observed to make Judgments \rfiich expressed either 
little differentiation or a complete lack of differentiation. That is, the 
majority of students made value Judgments vhich were merely categorical and 
absolute valu. claims about the goodness (or badness) of global features of 
their actions as students. No students made conditional Judgments \diich 
identified the multiple ways of viewing the worth of differentiated aspects 
of their actions as students. 

A test of the relationship between students' scores on the two scales 
used to measure mode of self-evaluation resulted in a correlation coefficient 
of O.U5 which is statistically significant at the 0.001 confidence level 
with 65 degrees of freedom. The two scales measure phenomena vhich have a 
positive, linear relationship. Since mode of self-evaluation is expected 
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to be a general iray of ' responding, this relationship vas as theoretically 
escpected. 

The results from testing the statistical hypothesis that there is no 
linear relationship hetveen students' level of conceptual development and 
degree of deliherateness in self -appraisal vere to reject this hypothesis 
at the 0,01 confidence level with 65 degrees of freedom. The correlation 
coefficient (r=0,37^) indicates that there is a positive linear relationship 
between students' scores on the two variables and, thereby, supports the 
theoretical expectation that as students develop more complex and abstract 
modes of functioning, they also use more of the process of evaluation in 
making self -appraisals. The low correlation was due to two conditions: 
Ca) the lowariability and lack of extreme scores in the set of scores and 
(.b) students at more mature levels of conceptual developnent \rho made 
self -appraisals showing little oise of the valuation process, rather than 
students at immature levels of conceptual development making judgments 
based on use of the process. 

The second statistical hypothesis tesjed was also rejected. With a 
correlation coefficient of 0.253, a statistically significant relationship 
was found at the 0.05 confidence level with 65 degrees of freedom between 
students' level of conceptual development and degree of differentiation in 
Judgments made. This positive linear relationship supported the theoretical 
expectation that these students having more mature conceptual structures, 
as compared to those students having more immature ones, in the judgments 
made, show more than a single, global way of viewing the value or worth of 
their actions as students. Their Judgments show that there are various value 
perapectlvea to use in evauLuating the worth of each aspect of their actions 
as students. Again, the low correliation was functionally related to the 
homogeneity In students' responses on the scale used to measure degree of 
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differentiation in Judgments made and lack , of extreme scores in the set of 
scores. It vas also due to the more mature conceptual level of students 
making undifferentiated Judgments. Students at the iinmature conceptual level 
did not make differentiated Judgments. 

IMPLICATIOHS FOR EDUCATIONAL DECISIOHMAKING 
HEGABDING PROPER USES TOR STODEWTS' SELF-EVALUATIONS 
This study has shown that students' evaluations of their own learning 
and performance in a course reflect more than only the content of what 
students say in such self -reports. Students' "self-evaluations" also 
reflect the particular intentions, dispositions and sets of meanings * 
students use to interpret and respond to qualities in the environment. Also, 
this study has shown that students vary in mode of self-evaluation and that 
these variations are functionally related to the way students' genotypic, 
personal characteristics interact with qualities in the environment. These 
restilts have practical significance for educators in deciding the proper 
interpretation of students' evaluations, and they have heuristic value in 
stiggesting a way to view students as eveuLuators and a way to approach 
research regarding students' evaluations. 

With respect to the proper interpretation of students' "self-evaluation", 
as when determining their reliability, ohjectivity, and validity, the 
results of this study indicate that looking at only the content of what is 
reported in students' evaluations is not an adequate methodological 
procedure. Tfeless educators examine the "contexts" of the students' 
Judgments, there is no way of determining whether students' Judgments have 
grounds or references which are empirical. If a student's Judgment is 
merely a "judgmental expression", it has no reference heyond that student's 
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saying It. According to the intellectual standards of objectivity and 
reliability, that Judgment cannot he considered trustworthy data. This 
study has'shovn that students' self -evaluations have both "person contexts" 
and "objective contexts" and that without examining the process students 
used in making their self-evaluation there is no way of determining the 
"contexts" of the Judgments made. As Kaplan C196I*) pointed out over a 
decade ago, without examining the contexts of what is reported, there is 
no way of determining whether the statement represents a mere value 
expression or represents a rational and deliberate value Judgment. If such 
procedures are necessary in order to interpret students' self -evaluations, then, 
for example, the cxirrently popular educational practice of using "quantitative" 
means to determine reliability (i.e., procediires such as counting the number 
of times a student, or students, say the same thing) should be considered by 
educators as an inadequate and incorrect way to measure reliability* 

Scriven (1972) has already criticized educators for the confusion which 
exists in education because of this "quantitative" notion of reliability. 
The results of this study have also shown that examination of only the 
content of students* Judgments is not ' sufficient to determine either their 
reliability or their validity of meaning. The same Judgment may represent very 
different psychological meanings to different students. Unless educators 
take psychological meanings into account, they are oversimplifying the 
meaning of students' self-evaluations. Educators will need to use data 
collection procedures (e.g., procedxires which £lL1ow for collection of 
Information regarding the process students use in making value Judgments) 
in order to meet the Intellectual atandcurds of reliability, validity and 
objectivity in :Jtidglng the quality of the data collected in students^ 
evaluations. Determining the quality of the data collected is always 
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necessary "before educators can be Jxistified In using data as the "basis for 
decisions and actions in education. To use extremely poor data to make 
generalizations is never acceptable professioneLL "behavior. Students' 
Judgments which are merely "spur of the inoment" rvs act ions cannot he 
considered trustworthy data to use as a basis for decisioniaaking, except to 
describe the intellectual characteristics of the data. 

IVirthermore , using students' evaluations as the basis for actions taken 
in planning learning and instruction may imdermine the intellectual aims of 
education. Some students may be encouraged to use irrational modes of 
evauLuating, if they observe educators using students' Judgments which are 
mere emotive reactions, as the basis for instructional planning. Therefore, 
educators cam have some confidence in rejecting, on intellectizal grounds, 
actions which are taken in education based only on responses to rating 
scales, since there is no way to properly interpret the intellectual 
qualities of responses made to rating scales. A proper use of students' 
self-evauLuations would be for purposes of diagnosis and for students' 
learning of the evaluative process and for students' gaining certain 
cognitive and motivational orientations needed to be rational and deliberate 
in evauLuating oneself. Helping students develop the dispositions and 
abilities they need to be rational and deliberate in evaluating should 
possibly be implemented as an educational objective. For students lower in 
conceptual level, these p'bJiectives should involve development of more 
abstract concepts and more abstract modes of thinking. Other objectives 
should be combined with these objectives for students higher in conceptual 
level, since seme of theise students were observed to use irrational modes 
of self-evaluation. 
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